REPORT  DOCUMENTATION  PAGE 


lb  RESTRICTIVE  MARKINGS 


3  DISTRIBUTION/  AVAILABILITY  OF  REPORT 

Approved.  fo1-  nuMic  -“’ease; 
distribution  unlimited. 


5  MONITORING  ORGANIZATION  REPORT  NUMBER(S) 


6*  NAME  OF  PERFORMING  ORGANIZATION 

Washington  State  University 

6b  OFFICE  SYMBOL 
(If  applicable J 

6c  ADDRESS  (Cry,  State,  and  ZIP  Code) 

Pullman,  WA  99164-2930 

8*.  NAME  OF  FUNDING /SPONSORING 

8b  OFFICE  SYMBOL 

ORGANIZATION 

(If  applicable) 

AFOSR 

m 

8c^A^QS^^jpfy,  State,  and  ZiPCode) 

Bldg  410 

Bolling  APB  DC  20332-6448 

AFOSR  TR.  ft 


7a  NAME  OF  MONITORING  ORGANIZATION 


RJ 


I  Ml] 


AFOSR/NM 


7b  sute‘ ind  zipcode> 
Bldg  410 
Bolling  APB  DC  20332-6443 


9  PROCUREMENT  INSTRUMENT  IDENTIFICATI 

AF0SR-83-0210 


10  SOURCE  OF  FUNDING  NUMBERS 


ow 


11  TITLE  (Include  Security  Classification) 

Rapidly  Convergent  Algorithms  for  Nonsmooth  Optimization 


12  PERSONAL  AUTHOR(S) 

Robert  Mifflin 


PROJECT 

TASK 

WORK  UNIT 

NO 

NO 

ACCESSION  NO 

2304 

fil 

YPE  OF  REPORT  13b  TIME  COVERED 

' 1  Scientific  from  15  Jul  87to  14  Jul  88 


14  DATE  OF  REPORT  (Year,  Month.  Day)  hS  PAGE  COUNT 

1988  July  15  4 


COSATi  CODES 


GROUP 


SUB-GROUP 


18  SUBJECT  TERMS  ( Continue  on  reverse  if  necessary  and  identify  by  block  number) 


19  ABSTRACT  ( Continue  on  reverse  if  necessary  and  identify  by  block  number) 

The  research  supported  by  this  grant  has  continued  the  development  of  efficient 
methods  for  solving  optimization  problems  involving  implicitly  defined  functions 
that  are  not  everywhere  differentiable. 

A  rapidly  convergent  algorithm  for  the  single  variable  case  where  generalized 
derivatives  are  known  is  currently  being  extended  to  the  n-variable  case. 

Also,  a  new  fast  method  has  been  developed  for  the  single  variable  case  where  only 
function  values  are  available. 


20  DISTRIBUTION /AVAILABILITY  OF  ABSTRACT  21  ABSTRACT  SECURITY  CLASSIFICATION 

□  UNCLASSIFIEO/UNLIMITEP  □  SAME  AS  RPT  □  OTIC  USERS  1  ^  ' 


22*  NAME  OF  RESPONSIBLE  iNOiviOUAL  |22b l  TELEPHONE  (Include  Area  Code)  22c.  OFFICE  SYMBOL 

Mai.  James  M.  Crowlev _  _ _  YM^)7(ol-50-Z(c  m 


DO  FORM  1473,  84  MAR  83  APR  edibon  may  be  used  until  exhausted.  SECURITY  CLASSIFICATION  OF  'HIS  PAGE 

All  other  editions  *r«  obsolete.  FT  -  ■  -  f~nT  c 

>  5ft-  ■  -i  ;  ! 


t 

\ 

The  research  conducted  under  Grant  Number  AFQSR-83-0210  during  the 

period  15  July  1987  to  14  July  1988  is  partially  documented  in  [7],  [3], 
[9]  and  [10]  and  related  to  previous  work  in  [1],  [3],  [4],  [5]  and  [6]. 
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Optimization  problems  with  functions  that  are  not  everywhere 

differertiable  cften  arise  when  certain  techniques  are  applied  to  large 
cr  complicated  nonlinear  programming  problems  in  order  to  convert  them 
to  a  sequence  of  smaller  or  less  complex  problems.  These  transformation 

techniques  include  decomposition,  nested  dissection,  relaxation,  duality 
and/or  exact  l\  penalty  methods  and  often  lead  to  functions  to  be  minimized 
which  ere  implicitly  defined.  Being  able  to  solve  such  problems  gives 
an  analyst  flexibility  in  modeling  a  problem  for  solution  and  the  ability 
to  exploit  parallel  processing  in  computation.  Hence,  it  is  important 
for  practical  applications  to  be  able  to  solve  such  problems  and  it  is 
the  goal  of  this  project  to  develop  efficient  solution  methods. 

Recent  joint  work  with  J-J.  Strodiot  (Namur,  Belgium)  has  produced 

theoretically  satisfying  ard  practically  useful  ideas  for  solving  single 
variable  minimization  problems  using  function,  but  not  derivative,  values. 
The  work  on  a  safeguarded  bracketing  technique  and  on  quadratic  approximation 
appears  in  [10]  which  ias  been  accepted  for  publication  in  Mathematical 
Programming.  Also,  this  effort  has  produced,  what  is  probably,  the  first 
instance  cf  a  function-value-only  method  for  nonsmooth  functions  with  proven 
rapid  convergence.  The  corresponding  paper  [9]  is  under  revision  in  order 
to  append  some  figures  to  illustrate  various  cases  mentioned  in  the 
introduction  and  considered  in  the  proofs  that  are,  unfortunately,  rather 
lengthy  ard  complicated. 
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The  above-mentioned  work  stems  from  a  bracketing  method  using 
generalized  derivatives  at  the  bracket  endpoints  developed  and  tested  in 
[4],  [6]  and  [7].  A  new  result  submitted  for  publication  in  [8]  states 
that  the  next  iterate  is  either  super! inearly  closer  to  the  solution  than 
both  of  the  current  bracket  endpoints  or  the  length  of  the  next  bracket 
is  superl  inearly  shorter  than  that  of  the  current  bracket.  This  work  was 
presented  in  October  1987  at  the  SIAM  35th  Anniversary  Meeting  in  Denver. 
A  FORTRAN  implementation  of  this  method  along  with  an  application  solved 
via  nested  optimization  has  appeared  in  [7].  A  Masters  degree  student, 
Han  Lim,  is  currently  working  on  using  this  method  in  a  nested  manner  to 
obtain  maximum  likelihood  estimates  of  the  three  parameters  in  the  Weibull 
probability  density  function  [11]. 

Current  research  is  concerned  with  developing  a  higher  than  first 
order  method  for  n- variable  implicitly-defined  nonsmooth  problems  based 
upon  ideas  in  [3]  and  [5].  A  former  research  assistant,  David  Elwood, 
has  written  a  FORTRAN  code  that  can  be  used  to  test  new  ideas  developed 
in  the  course  of  this  research. 

A  Master's  degree  student,  Allison  Radcliffe,  has  written  a  computer 
code  for  smooth  optimization  which  is  a  specialization  of  our  nonsmooth 
method.  It  is  intended  to  investigate  the  performance  of  a  method  that 
uses  both  BFGS  and  symmetric  rank  one  updated  Hessian  matrix  estimates. 
The  desire  is  to  obtain  the  advantages,  and  not  the  disadvantages,  of  both 
updates. 
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The  two  n-variable  codes  mentioned  above  use  the  general  purpose 
quadratic  programming  subroutine  QPSOL  [7]  to  solve  the  search  direction 
finding  subproblems.  For  efficiency  in  future  implementations  it  may  be 
beneficial  to  develop  a  special  purpose  method  based  on  the  Ph.D. 
dissertation  of  A.  Al-Saket  [1].  Two  papers  based  upon  [1]  are  now  being 
prepared  for  publication  submission. 


Accession  For 

,  Nil 3  GFA&I 
i  DTIC  j- A3 
■  Unannounced 

1  Just:  V:atlor 


(3) 


REFERENCES 


[1]  A.  Al-Saket,  An  algorithm  with  degeneracy  resolution  for  solving  certain 
quadratic  programming  problems.  Dissertation,  Washington  State 
University,  Pullman,  WA,  1985. 

[2]  P.E.  Gill,  W.  Murray,  M.A.  Saunders,  M.H.  Wright,  User's  guide  for 

SOL/QP  SOL :  A  FORTRAN  package  for  quadratic  programming,  Technical 

Report  SOL  82-7,  Department  of  Operations  Research,  Stanford  University, 
Stanford,  USA,  1982. 

[3]  N.  Gupta,  A  higher  than  first  order  algorithm  for  nonsmooth  constrained 
optimization,  Dissertation,  Washington  State  University,  Pullman, 
WA  1985. 

[4]  R.  Mifflin,  Stationarity  and  superlinear  convergence  of  an  algorithm 
for  univariate  locally  Lipschitz  constrained  minimization,  Mathematical 
Programing  28  (1984),  50-71. 

[5]  R.  Mifflin,  Better  than  linear  convergence  and  safeguarding  in  nonsmooth 
minimization,  in  P.  Thoft-Chri stensen ,  Ed.,  System  Modeling  and 
Optimization  (Springer-Verlag,  New  York,  1984). 

[6]  R.  Mifflin,  The  solution  of  a  nested  nonsmooth  optimization  problem, 
Nondifferentiable  Optimization:  Motivation  and  Applications,  V.  Demyanov 
and  D.  Pallasche  Eds.,  Springer-Verlag,  New  York,  1985. 

[7]  R.  Mifflin,  An  implementation  of  an  algorithm  for  univariate 
minimization  and  an  application  to  nested  optimization.  Mathematical 
Programming  Study  31  (1987)  155-165. 

[8]  R.  Mifflin,  On  superlinear  convergence  in  univariate  nonsmooth 
minimization.  Department  of  Pure  and  Applied  Mathematics,  Washington 
State  University,  Pullman,  WA  1986,  submitted  for  publication. 

[9]  R.  Mifflin  and  J.-J.  Strodiot,  A  rapidly  convergent  five  point  algorithm 
for  univariate  minimization.  Report  of  the  Department  of  Mathematics, 
Facultes  Uni versi tai res  de  Namur,  Namur,  1986. 

[10]  R.  Mifflin  and  J.-J.  Strodiot,  A  safeguarded  bracketing  technique 
for  obtaining  convergence  and  preserving  rapid  convergence  in  univariate 
minimization,  to  appear  in  Mathematical  Programming. 

[11]  S.  H.  Zanakis,  Computational  experience  with  some  nonlinear  optimization 
algorithms  in  deriving  maximum  likelihood  estimates  for  the 
three-parameter  Weibull  distribution,  TIMS  Studies  in  the  Management 
Sciences  7,  (1977),  63-77, 

(4) 


#1-010-B 


